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ABSTRACT 



In studies of interventions (e.g., remedial reading 
interventions) , interest often centers on student academic progress or on 
changes in various attitudinal and affective measures, both during and after 
the intervention period. By enabling us to subdivide a time series into 
meaningful segments, and summarize important aspects of change in each 
segment, piecewise growth models provide a means of addressing key questions 
in intervention studies. In this report, the use of piecewise models is 
discussed for: (1) examining whether rates of progress for individuals in an 

intervention study, on average, slow down, remain constant, or speed up 
during the follow-up period; (2) assessing whether there is substantially 
more variability among individuals in their rates of change in the 
intervention period or in the follow-up period; and (3) identifying 
conditions under which rapid rates of progress are seen during the 
intervention period and sustained progress during the follow-up period. An 
appendix contains a coding scheme for the piecewise model. (Contains one 
figure, five tables, and six references.) (Author/SLD) 
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THE USE OF PIECEWISE GROWTH MODELS IN EVALUATIONS 

OF INTERVENTIONS 

Michael Seltzer 

CRESST/University of California, Los Angeles 
Martin Svartberg 

Norwegian University of Science and Technology 



Abstract 

In studies of interventions (e.g., remedial reading interventions), interest often centers 
an student academic progress, or an changes in various attitudinal and affective 
measures, both during and after the intervention period. By enabling us to subdivide a 
time series into meaningful segments, and summarize important aspects of change in 
each segment, piecewise growth models provide a means of addressing key questions in 
intervention studies. In this report, we discuss the use of piecewise models in (1) 
examining whether rates of progress for individuals in an intervention study, cn 
average, slow down, remain constant or speed up during the follow-up period; (2) 
assessing whether there is substantially more variability among individuals in their 
rates of change in the intervention period or in the follow-up period; (3) identifying 
conditions under which we see rapid rates of progress during the intervention period, 
and sustained progress during the follow-up period. 



In studies of interventions (e.g., preschool initiatives such as Head Start; 
remedial reading interventions), interest often centers on student academic 
progress, or on changes in various attitudinal and affective measures, both 
during and after the intervention period. Of particular concern is how well 
students fare after an intervention ends: Do rates of progress /improvement tend 
to hold steady (or perhaps even increase), or do they tend to decline? 

Growth modeling provides a valuable framework for studying the effects of 
interventions over time (see, e.g., Muthen & Curran, in press; for an 
introduction to growth modeling, see Bryk & Raudenbush, 1992). In this paper, 
we wish to illustrate the value of piecewise growth models in exploring issues of 
the kind outlined above. As will be seen, for each time period or segment of 
interest in a time series (e.g., the intervention period; a post-intervention follow- 



up period), the piecewise model enables one to estimate, for example, a mean 
rate of growth /progress, and the amount of variation among individuals in their 
rates of growth. In addition, one can attempt to identify key correlates of growth 
for each time segment of interest: How do differences in implementation and 
student background characteristics relate to differences in rates of 
growth /progress during the intervention? What factors are instrumental in 
promoting sustained progress after the intervention has ended? 

To illustrate the value and use of piecewise growth models in studies of 
interventions, and to discuss some of the limitations of more conventional 
growth modeling strategies in such settings, we focus on analyses of the data 
from a study of the relative effectiveness of two types of short-term 
psychotherapy interventions. In the course of presenting our analyses, 
implications for the study of school-based interventions will emerge. We will 
explore a number of these implications. 

An Illustrative Example: The STAPP/NDP Intervention Study 

The data that we will use are based on a randomized trial conducted by 
Svartberg, Seltzer and Stiles (in revision) comparing two forms of short-term 
psychotherapy. From a pool of 20 individuals referred for short-term 
psychotherapy, 10 were randomly assigned to a directive, psychodynamic form of 
therapy termed STAPP, and 10 were randomly assigned to a non-directive form 
of therapy (NDP). In both the STAPP and NDP interventions, patients received 
20 sessions of treatment. A key outcome of interest in this intervention is level 
of client distress as measured by an instrument termed the Symptom Checklist- 
90 (SCL-90; Derogatis, 1977). Efforts were made to measure levels of distress at 
multiple points in time: immediately prior to the start of treatment, after 10 
sessions, at termination, and 6, 12 and 24 months after termination. 

The trajectories of SCL-90 scores for three clients are displayed in Figure 1. 
Note that on the SCL-90 scale, scores between 0 and 0.20 indicate that an 
individual is asymptomatic; scores between 0.20-0.40 indicate mild levels of 
distress; scores between 0.40-1.00 indicate moderate levels of distress; and scores 
exceeding 1.00 indicate severe symptomology. In Figure 1, we see that Client 4's 
initial SCL-90 score is approximately 0.50 and that his scores decline over the 
intervention period; at termination, Client 4's SCL-90 score is close to a value 







■ Client 4 
a Client 8 
• Client 14 



Figure 1. SCL - 90 Trajectories for Clients 4, 8 and 14. Termination occurred at 5.9 months, 8.9 months 
^ and 7.5 months for Clients 4, 8 and 12, respectively. 

of 0. In the follow-up period, it can be seen that Client 4's SCL-90 scores hold 
fairly steady, taking on values toward the low end of the SCL-90 scale. Fairly 
^ similar patterns occur for Clients 8 and 14: We see declines in their levels of 

distress during the intervention period, and their scores hover in the 
asymptomatic range of the scale in the follow-up period. 

^ For nearly all clients in the sample, we observe declines in levels of distress 

during treatment, and a flattening out of rates of change in the follow-up period. 
As illustrated by the 3 trajectories displayed in Figure 1, clients differ in terms of 
their initial levels of distress, in terms of how rapidly they improve during the 
* treatment period, and in terms of their levels of distress at termination. 
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A Quadratic Model for Individual Growth 

Growth modeling provides a valuable framework for studying change over 
time. It enables us to estimate an average growth trajectory for the individuals in 
a sample, estimate the extent to which individuals vary in terms of various 
aspects of change (e.g., in their rates of change), and identify key correlates of 
change (e.g., to what extent do individuals in the STAPP and NDP interventions 
differ in their rates of change?). Growth models consist of two models: a model 
for individual growth, which is often termed a within-person model, and a 
model that enables us to study differences in growth across individuals, which is 
often referred to as a between-person model. 

In settings in which plots of individual growth trajectories display 
curvature, as in the case of the trajectories displayed in Figure 1, data analysts 
typically use a quadratic model to model individual growth. Thus in the case of 
the STAPP/NDP intervention data, we might pose a quadratic model of the 
following form: 



Yti = j3oi + $u(Monthti - Ci) + $ 2 i(Monthti - Ci ) 2 + £ti (1) 

where Y H is the observed SCL-90 score for individual i at measurement occasion 
t, and Month ti captures the number of months that have elapsed since the start of 
treatment for person i at measurement occasion t. Thus, for example, at the third 
measurement occasion (t = 3) for Client 4 (i = 4), Month ti takes on a value of 5.90. 
The parameters P 0i , P i; , and P 2i are termed growth parameters. The meanings 
that we attach to the parameters P m and P^ depend upon the term q in Equation 
1. If we set q = 0, then P 0i represents the SCL-90 status for person i at the start of 
treatment (i.e., initial status) and P u represents the initial rate of change for 
person i. If we set q equal to the value of Months at termination (e.g., c 4 = 5.90 in 
the case of Client 4), then P 0i represents the SCL-90 status for person i at 
termination and P 1; represents the rate of change for person i at termination. P 2i 
captures the amount of curvature in individual i's growth trajectory; that is, the 
acceleration or deceleration in SCL-90 scores for person i. P 2i is a characteristic of 
the entire trajectory; its meaning, in contrast to P 0l and P u does not depend on q . 
Finally, e ti is an error term assumed normally distributed with mean 0 and 
variance a 2 . 



A hallmark of growth models is that growth parameters contained in the 
within-person model (e.g., P^, P^, and P 2i in Equation 1) are treated as outcomes 
in a between-person model. Thus we can examine, for example, whether there 
are systematic differences between STAPP and NDP clients in terms of their 
status at termination (P 0i ) and in terms of their acceleration or deceleration across 
the time frame spanned by the study. 

The Need for Piecewise Models in Intervention Studies 

In the above study, as in many intervention studies, we have two very 
distinct time periods: the intervention period and the follow-up period. As 
such, those factors connected with differences in change in the first period may 
differ substantially from those that are instrumental in the second period. That 
is, those factors that are related to differences in rates of change, for example, in 
the intervention period, may differ substantially from those that are related to 
rates of change in the follow-up period. In addition, rates of change may be 
highly variable among individuals in one period, but fairly homogeneous in 
another period. 

The quadratic model for individual change, however, does not readily lend 
itself to exploring issues of this kind. In particular, the parameters p 0i and P u 
provide summaries of individual growth at a specific point in time, and P 2i 
provides a summary of the entire time series for an individual. What is needed, 
in contrast, is a model for individual change that explicitly captures the fact that 
our study spans two qualitatively distinct periods — that is, a model that contains 
parameters that capture or summarize important features of change in the 
intervention period and in the follow-up period. 

Piecewise models for individual growth provide a means of dividing a time 
series into meaningful segments, and capturing key features of change in each 
segment. In our illustrative example, we employ a two-piece linear model for 
growth (Bryk & Raudenbush, 1992, pp. 148-151; Seltzer, Frank, & Bryk, 1994) that 
yields summaries of change for a client in the treatment and follow-up periods. 

As outlined in the Appendix, we use the variable Month ti to create two 
predictor variables (i.e., Monthtrt ti and Monthaft ti ), which enable us to capture a 
client's rate of change in the treatment period and his or her rate of change in the 
follow-up period: 
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= p oi + Pjj Mon thtrt ti + $ 2i Monthaft ti + e H 



(2) 



Y 



where P 0i now represents the rate of improvement for client i during the 
intervention period and P 2i captures the rate of improvement for client i during 
the follow-up period. Our coding scheme for Monthtrt ti and Monthaft ti is such 
that P 0i represents SCL-90 status for person i at termination. As in Equation 1, the 
£ ti are errors assumed normally distributed with mean 0 and variance a 2 . 

Utilizing the Piecewise Model 

We first seek to estimate a mean improvement trajectory for the 
individuals in our sample, and examine the extent to which individuals vary 
around the mean trajectory. To do this, we pose a between-person model of the 
following form for the 20 clients in our sample (i = 1, ... , 20): 



P(H = Yoo Yoi + U(M U„ ~ N(0,xj 

Pii = Yio Yii + Ujj U, ~ N(0,x n ) 

P 21 = Y20 Y2i U 2i U 2j — N(0,x 22 ) , (3) 

\ 

Focusing on the equation for P 1S , we see that individual rates of change during 
treatment are modeled as a function of a mean rate of change for the treatment 
period, i.e., y 10 . U lf is a residual that captures the deviation of the rate of change 
for person i during treatment from the average rate. The U H , which are termed 
random effects, are assumed normally distributed with mean 0 and variance x n . 
Thus x n captures the variation in individual rates of improvement during the 
treatment period around the average rate. Similarly, y 20 represents the mean rate 
of change for the follow-up period, U 2i is a random effect that captures the 
deviation of the rate of improvement for person i during the follow-up period 
from the mean rate, and x 22 represents the variation in individual rates of 
improvement during the follow-up period. Finally, Yoo represents mean status at 
termination, U 0i captures the deviation in termination status for person i from 
the mean value, and x 00 captures the variation across individuals in termination 
status. 

Note that in the parlance of growth models, y 00 , y w and y 20 are termed fixed 
effects, and x 00 , x n , and x 22 are referred to as variance components. We also 



